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VIRTUAL MAKEOVER SYSTEM AND METHOD 

Cross-Reference To Related Applications 

This application claims priority from U.S. Provisional Patent Application Serial No. 
60/229,410, filed on August 31, 2000, entitled "Virtual Makeover System and Method," 
which is expressly incorporated by reference herein. 

Background of the Invention 

The present invention relates to virtual makeover systems, and more particularly to a 
method and system for a virtual makeover utilizing a communications network and/or an 
application stored on a computer readable medium, such as a CD-ROM. 

Through the use of the Internet, many companies have begun to use virtual 
visualization applications in attempt to personalize the on-line shopping experience. The 
goal has been to provide Internet users with a purchasing experience that is as close to reality 
as possible. The ability of consumers to mix, match, and view different products together 
over the Internet has significantly enhanced the Internet buying experience. 

Beauty product vendors have also begun to use such virtual shopping techniques as 
well. Users can create a virtual figure to try on clothing, or they can upload a personal 
photographic image (i.e., a "headshot") to try on beauty products. Makeoverstudio.com , for 
example, allows users to electronically submit a personal "headshot" photograph over a 
communications network. The company then notifies the user when the headshot is ready for 
a makeover, and the user can then enter the web site and select different products to view 
with the personal image. The user appears to be trying on makeup and other products, but is 
not doing so. Once the user has selected the desired hairstyle and makeup, the user can 
determine how to achieve the desired look, and a list of products available for purchase is 
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provided to the user. Although somewhat useful, this system does not allow a user to 
customize the application of beauty products. Rather, the system predetermines the area and 
the shape of the area in which the items can be applied. In addition, the user can only apply 
and view products over an Internet connection. 

Users can also purchase software programs that allow the user to evaluate different 
products, such as Cosmopolitan's Virtual makeover. The program is equipped with a variety 
of hairstyles, accessories, and cosmetic products that can be virtually evaluated. Users are 
instructed to upload a personal image or headshot, then align the headshot for application. 
The alignment process requires the user to select and position preset shapes upon the image 
until they are generally in-line with the areas of the face. The user may then select wigs, 
products, and accessories to apply to the personal image. This system also suffers from the 
drawback that it cannot be customized by the user. 

Despite the existence of such virtual makeover systems, there remains a need for an 
improved method and system for a virtual makeover. 

Summary of the Invention 

The present invention relates to a virtual makeover system and method which allows 
users to apply beauty products to a personal photographic image, thereby creating a digitally 
enhanced image. The system and method can be used over a communications network, and 
can also be provided to users as an application, such as a software program. The application 
can be stored on a computer readable medium, or it can be downloaded via the Internet. 

The system of the present invention generally includes a product catalog, a palette 
database, and an image database, all of which may be accessed by a user via a 
communications network or stored on the hard drive of a user's computer. The product 
catalog is maintained by the system or host site and includes a variety of beauty products 
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available for purchase, such as wigs, glasses, contacts, eye shadow, blush, eye liner, lipstick, 
lip liner, foundation, eyebrow color, hair color, eye lashes, etc. of various styles, brands, and 
colors. The product catalog may be downloaded to the user's computer for off-line access by 
the user. The palette database contains pre-configured palettes, which may be created by 
vendors and service providers, and user-created palettes. A palette is essentially a complete 
makeover, consisting of a collection of beauty products, which can be "applied" instantly to 
an image on the computer screen, together with suitable modem graphics instructions 
implementing the manner, location, and form in which they are to be applied. The image 
database consists of several digital photographic images provided by the user and/or by the 
system. 

In one aspect of the present invention, users can upload digital photographs of 
themselves or others. One of ordinary skill in the art will readily appreciate that several 
different methods and systems exist for uploading and viewing images, and that all known 
methods and systems can be used with the present invention. 

Once a photograph is uploaded or selected, the user then identifies the basic 
parameters of the head and face in the photograph using adjustable guides. Then, the user 
selects various features in the photograph and outlines these features. During the outlining 
step, the user defines the size and shape of a specific feature for which future treatment or 
manipulation is desired. Preferably, a default shape is provided for each feature which 
consists of several points connected by lines to form a shape. The user outlines the feature 
by selecting and moving the one or more points to alter the orientation of connected lines, 
thus creating a new shape. Once each feature is outlined, the user can save the newly formed 
shapes in connection with the particular photograph. 

In one aspect of the present invention, users can send the photograph with the saved 
outlined features to other users. The selected features can include, for example, the face 
shape, which includes the forehead, left side, and right side of the face, the eyes, lips, eye 
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creases, eyebrows, eye highlights, cheeks, and irises. Other features can include the head, 
eyeliners, eyelids, and eyelashes. Tools are also provided which allow the user to reshape, 
move, zoom in/out, add/delete points, rotate, or erase the default outlines. The tools are 
implemented in a manner similar to such tools provided with computer graphics programs, 
5 and are implement by moving a pointer, clicking on property or task selection buttons, and 
the like. A virtual brush with a color palette, and an eyedropper for painting and removing 
red-eye can also be provided. 




q Once the user has finished outlining a photograph, the user may then apply selected 

*ff) beauty products from the product catalog to the image thereby creating a digitally enhanced 
yj image and participating in a virtual shopping experience. Users can save the digitally 

■s.iTl 

enhanced image as a new image. In one embodiment, users can change the opacity and/or 
^ thickness of the applied products. 

jri> In a further embodiment of the present invention, users can save the selected beauty 

f J products applied to an image as a palette. The palettes can be applied to other images, or 

Q sent to other users for application. The user-created palettes may be stored in the palette 

database or on the hard drive of a user's computer. 

20 In yet another embodiment of the present invention, a shopping cart is provided for 

saving selected products. The "shopping cart" is a tool that allows users to save one or more 
beauty products of interest to the user. The one or more items placed in the shopping cart 
may be stored (preferably temporarily) on the user's computer hard drive for subsequent, 
local use. The user is thus able to engage in an off-line virtual shopping experience. Once a 

25 user elects to purchase one or more items, the user can connect to the system to place an 
order for the desired items in his/her shopping cart. Any items purchased by the user are 
subsequently removed from the shopping cart. However, users may view prior purchases to 
place subsequent orders for items previously purchased. Users may add or remove any items 
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from the shopping cart at anytime, and may send a wish list containing the items in the 
shopping cart to other users. 

In a further embodiment of the present invention, users may access the image 
database to select a pre-set (outlined) image to use for a makeover. While the pre-set image 
does not require users to outline the features, users may adjust the outline shapes so as to 
change the shape of the features that are outlined. Users can also apply saved palettes to the 
pre-set images. In another embodiment, some of the images in the image database have pre- 
configured palettes stored with the image. Users can apply a pre-configured palette to their 
own photographic images, or to other user photographic images, and can also place an order 
for one or all of the items in the palette. 

Brief Description of the Drawings 

The invention will be more fully understood from the following detailed description 
taken in conjunction with the accompanying drawings, in which: 

FIG. 1 is a diagram of the general system and the users of the present invention. 

FIG. 2 is a diagram of the general method of the present invention. 

FIG. 3 is a diagram of the general method for setting up a photographic image in 
accordance with the present invention. 

FIG 4. is a diagram illustrating the default shapes for outlining features in a 
photographic image in accordance with the present invention. 

FIG. 5 is a diagram illustrating the general makeover process of the present invention. 
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FIG. 6 illustrates the opacity and thickness controls which can be used in 
embodiments of the present invention. 

FIG. 7 illustrates the step of selecting a feature to makeover in accordance with the 
present invention. 

FIG. 8 illustrates the step of selecting a product for the feature selected in FIG. 7. 

FIG. 9 illustrates the step of selecting a color or style to apply to the feature selected 
in FIG. 7. 

Detailed Description of the Invention 

The present invention is directed to a virtual makeover system and method which 
allows users to apply beauty products to a digital photographic image, thereby creating a 
digitally enhanced image. Beauty products can be applied to the images as part of a virtual 
shopping experience and/or for purposes of entertainment and education. More particularly, 
the present invention provides a method and system for outlining features in a digital 
photographic image, and subsequently applying beauty products to the outlined features. 
The system and method can be used over a communications network, and can also be 
provided to users as an application, such as a software program for use locally on a personal 
computer system. The application can be stored on a computer readable medium, or it can be 
downloaded from the Internet. A product database containing a plurality of beauty products 
available for purchase is provided by the system or the application. The beauty products in 
the product database are computer manipulable by the user such that specific beauty products 
can be applied to and displayed in connection with the outlined features of a photographic 
image. Users can provide their own photographic images, or can obtain an image from an 
image database. Users can search for, select, and apply different products to the 
photographic image. The new digitally enhanced image, with the products applied, can be 
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saved as a snapshot image. The applied products can also be saved as a palette in a palette 
database or on the users' hard drive, and can also be placed into a shopping cart for future 
use and/or purchase. Users can also electronically exchange outlined photographic images, 
snapshot images, and saved palettes with other users. 

^Figure 1 illustrates the general system 10 of the present invention, which includes a 
product cWlog 1 1, a palette database 12, and an image database 13. The system can be 
accessed visNa communication network, e.g. the Internet, or can be provided to users as an 
application, suck as a software program for use locally on a personal computer system. The 
application can beSlored on a computer readable medium, or it can be downloaded from the 
Internet. If the systemas stored on the hard drive of a user's personal computer system, the 
user can connect to the lW site, such as through an Internet connection, to download any 
changes or updates to the sWtem 10 itself, as well as to the product catalog 11, palette 
database 12, and image database 13. 

The product catalog 11, which is maintained by the system and is downloadable to a 
user's hard drive, includes a variety oltaauty products offered by different vendors. Beauty 
products include, for example, wigs, glasses, contacts, eye shadow, blush, eye liner, lipstick, 
lip liner, foundation, eye brow color, hair coW hair styles, eye lashes, etc. of various styles, 
brands, and colors. \ 

The palette database 12 contains pre-configurWi palettes and user-created palettes. A 
palette consists of a combination of beauty products, wflteh together create an image, or 
makeover. The pre-configured palettes are created by the system, or can be created by a 
service provider, e.g., a makeup artist, or vendor. \ 

The image database 13 contains one or more digital photoWaphic images, including 
pre-set images, pre-configured images, and user-saved images. Preset images are already 
set up for the user and thus do not require the user to outline the feature^ in the image. 
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How^yer, the user may change the shape of any of the outlined features. Pre-configured 
images are images which have already been made-over. That is, a specific palette has been 
applied to tt^image. The user-saved images can include images which are setup and saved 
by the user, anablso digitally enhanced images which have products applied thereto. 

The various usersHhat can access the system include vendors 15, potential buyers 16, 
service providers 17, and otnbr users 18 in general. Vendors 15 may, for example, access the 
product database to add or remo\j>roducts offered by the vendor, or to update the product 
listing. Beauty service providers maWccess the palette database to create new palettes for 
customers of the service provider. It is uhderstood that access to the system and its various 
databases is generally controlled by the systeh^ or host site. 

The general method of the present invention is illustrated in Figure 2. A user first 
selects and views a new photographic image 1 A, a pre-set image IB, or a pre-configured 
image 1C to makeover. If the user selects a new image 1 A to makeover, the user must setup 
the image 2, which consists of aligning the image, and then outlining selected features 3 in 
the photograph. The method of aligning the image and outlining the features will be 
described in more detail below with reference to Figure 3. Once the user has finished 
outlining the features, the user may then save the outlines in connection with the image 4 and 
begin the makeover 5. If the user selects and views a pre-set image IB, the user may skip the 
setup step, and directly begin the makeover 5. If a user selects a pre-configured image, 
which is saved in conjunction with a palette, the image will be displayed to the user with the 
palette applied to the outlined features in the image. The user may change the palette, adding 
or removing additional products selected from the product catalog. 

In order to begin the makeover 5, the user may either select a pre-configured palette 7 
from the palette database stored in the system or application, or the user may select specific 
features to makeover 6. If the user selects a pre-configured palette 7, a made-up image 
having the products in the pre-configured palette is applied to features in the photograph 8 
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and displayed to the user. The user may then make changes to the pre-configured palette 9, 
or add some or all of the products in the pre-configured palette to the shopping cart 17. If the 
user elects to make changes to the pre-configured palette, the user begins by selecting a 
specific feature to makeover 6. 



Once a feature is selected 6, a list of available products which can be applied to that 
feature is stoawn to the user 1 0. The user then selects a desired product 11. All colors and 
styles available ftv^hat product are shown to the user 12. The user may then select a color or 
style 13, and view th^Smage with the product applied to the selected feature 15. The user 
may also adjust the thickn^or opacity of the applied product 14. When the user is finished 
selecting and applying products^features in the image, the user may save the digitally 
enhanced image in the image databas^and can optionally send the image to other users. The 
user can also save the selected products asVnew palette 16. The palettes can be applied to 
other images, or sent to other users for applicatib^l8. The makeover process is described in 
more detail below with reference to Figure 5. 



In one embodiment of the present invention, the user may place one or more items 
from the product catalog in a shopping cart 17 for storage (preferably temporarily) on the 
user's computer hard drive for subsequent, local use. The "shopping cart" is a tool that 
allows users to save, for convenient future access, one or more beauty products of interest to 
the user. The user is thus able to engage in an off-line virtual shopping experience. 

The^hogping cart can also be used to facilitate purchases of beauty products. Once 
the user has identifiea^beauty products for which purchase is desired, they are preferably 
placed in the user's shoppingclltft^The user is able to indicate to the system that the user 
desires to purchase all, or selected, itenfe^ithe shopping cart. The system will then 
electronically connect to the host site, via a coi&Kimiications network, and process the user's 
order and charge the transaction costs to a user crediutes^unt provided by the user to the 
system at the time or ordering, or previously provided to the system by the user. Items 
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placed inlttfc-shQpping cart, whether or not purchased, may be saved for future use by the 
user. Users may alscrrei&w^any items from the sopping cart, send a wish list containing the 
items in the shopping cart to otheruSfcfS^ save the items in the shopping cart for future use. 



1° 



»5 



20 



25 



In one embodiment, the user may connect to the system, such as through an Internet 
connection, to download one or more products to the user's shopping cart. Once all desired 
products are loaded into the shopping cart, the user may disconnect from the Internet or other 
electronic connection. Despite being disconnected from the system (or host site), the 
shopping cart, and the products therein, remain on the user's computer (e.g., on the hard 
drive) and are available for use by the user without an electronic connection to the system. 
One of ordinary skill in the art will readily appreciate that in order to take full advantage of 
this feature one should have the appropriate software present on his or her computer, and that 
such software may be downloaded from the system or otherwise provided by the system, 
directly or indirectly, to the user. 



Figbss 3 illustrates the general method for setting up a photograph, which comprises 
uploading or seWing a photographic image 21, outlining features 22, and saving 24 the 
outlined features. The system may also include instructions 23 for outlining features and 
using the outlining toolsSOne of ordinary skill in the art will readily appreciate that several 
different methods and system^xist for uploading and viewing images, and that all known 
methods and systems can be usedS^ith the present invention. Typically, the user will provide 
a JPEG image, a so-called "internet im^ge" made by a simple digital snapshot camera 
attached to a home computer, or a photo CD (".pcd") image file. The application program 
for a system of the present invention may opdWe with any of these, and preferably includes 
a module which determines image file type and resizes the image as appropriate to fit the 
virtual makeover display screen. This allows the userto employ images from any source, 
from scanned home snapshots, home digital pictures, andWages copied from the Internet. 
Once a photograph is uploaded, the users may outline 22 theteatures. When the selected 



* 
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features are^tttiiQed, the user can then instantly apply beauty products to a desired feature 
without having to drawSftd/Qr paint. 



The term "features," as used herein, is understood to refer to various, discrete regions 
of a person's face, or an image of a face, to which one or more beauty products are 
commonly applied. Each feature generally has a certain shape, and as described below with 
respect to Figure 4, certain default shapes are provided. The shape of each feature can be 
altered, or "outlined" by a user. 

Figure 4 shows an exemplary default shape or outline for each feature. The shapes 
are defined by a series of points 50 connected by lines 52 to form a desired shape. The user 
can select and move a point 50, thus changing the shape of the outline. Each time a user 
moves a point 50, the lines 52 connected to the point 50 move with it. Theuser can adjust all 
of the points 50 until the feature is outlined in a manner desired. Tools are also provided for 
adjusting the size and location of the shapes. Once all of the desired features are outlined by 
the user, the user can save the outlined features in connection with the photographic image 
for future use. 

Wi{h reference to Figure 4, the default shapes are shown for various facial features. 
Features inclu^^e face shape 71, which includes the forehead 71A, the right side 71B, and 
the left side 71C of th^ce, the, hair 71D, eyes 72, lips 73, eye creases 74, eyebrows 75, eye 
highlights 76, cheeks 77, ancNi^ses 78. Other features can include the head, eyeliners, 
eyelids, and eyelashes. The tools jJte^ided (Figure 2) allow the user to reshape 81, move 82, 
zoom in/out 83, add/delete points 84, rot^85, or erase 87 the default outlines. A brush 89 
with a color palette 88, and an eyedropper 86 al^also provided for painting, removing red- 
eye, and selecting colors from the digital image fort^ewith the brush 89. 

Once the user has saved 24 the outlined features in connection with the photographic 
image, the user may then proceed to makeover the image. It is uiKhsrstood that the process of 
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rkaking over the image can be for purposes of virtual shopping and/or for education and 
entertainment. Figure 5 illustrates the general makeover process 30. The user may choose 
from several options, including shadow the eyelid, shadow the eye crease, and shadow the 
highlighNareas. Further, the user can choose to apply eyeliner, eye brow color, eyelashes, 
blush, foundation or powder, lip liner, and lipstick. The user can also opt to try on contacts, 
glasses and wi^s. Once the user chooses an option, the user may select a product from a list 
of products, typically identified by brand name and/or product number. Users may also 
search for a specificVoduct. Each product may contain a description of the product, along 
with a picture, if available. All of the colors and/or styles of that product are then displayed 
to the user. The user may^hen choose a color and/or style to apply to one or more selected 
features. The altered photographic image is then displayed to the user with the selected 
product or products applied to f^e selected features. The user may, at any time during the 
makeover process, adjust the applWion of each product by selecting the desired thinness or 
thickness, or selecting the transparency of the applied product. By way of non-limiting 
example, Figure 6 illustrates a photogr^hic image 40 with eyeliner applied to the eyeliner 
features 42. The user may select the desireH^vidth of the eyeliner by sliding the width button 
44 to the left or right thereby making the eyeliW thin or wide. The user may also adjust the 
opacity of the eyeliner by sliding the opacity butW 46 to the left or right thereby making the 
applied eyeliner light or heavy. One having ordina\skill in the art will readily appreciate 
that other product application controls can be provided^, 

By way of example, if a user selects to apply shadow to the eyelids (Figure 7), a list 
of eye shadow products from the product database will be displayed to the user (Figure 8). 
The user may then choose a product, and all the colors available for that product are 
displayed (Figure 9). The user then selects a color, e.g. Hi Ho Silver, and the eye highlight 
outlined in the photographic image is colored with Hi Ho Silver. The user may than adjust 
the application of the eye shadow by selecting the desired opacity of the shadow using the 
opacity button 46. The eye shadow will be displayed in the photographic image as adjusted 
by the user. 
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Once the user has finished enhancing the image with beauty products, the enhanced 
image with the applied products can be saved on the system in the image database. The 
combination of products applied to the image can also be saved as a palette in the system's 
palette database. The palettes designed by a user can be saved, locally or on the system, and 
can be applied subsequently to other images, or sent to other users for application to images 
to be manipulated by such other users. 

In a further embodiment of the present invention, users can experiment with and "try 
on" beauty products to determine what colors, shapes, and styles accentuate the natural 
features in ones face, such as the shape of the eyes, cheeks, and nose. The colors used by the 
system are designed to represent the true color of the product, thus enabling the user to 
virtually view the product as it would appear on the user's face. 

In another embodiment, pre-set photographic images can be provided to the user. 
Pre-set images are setup, and thus do not require the user to outline features in the image. 
Users can, for example, select a photograph of a celebrity from the image database and apply 
selected beauty products to the celebrity photograph. Users can also apply previously saved 
palettes and pre-configured palettes to the celebrity photographs. In another embodiment, 
users can select a pre-configured image, wherein a palette is applied to the image. Users can 
use the palette used on the pre-configured image to "achieve the same look" by applying the 
same beauty products to the user's own photograph, or to other user-related photographs. 

While the present invention has been described herein with reference to particular 
embodiments thereof, a latitude of modification, various changes, and substitutions are 
intended in the foregoing disclosure. For instance, the present invention also empowers 
users to obtain pre-set palettes used by celebrities. Other types of beauty products can also 
be included, such as earrings and other accessories. Thus, it will be appreciated that in some 
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instances some features of the invention may be employed without corresponding use of 
other features. 

One of ordinary skill in the art will know, or be able to ascertain, using no more than 
routine experimentation, many equivalents to the specific embodiments of the invention 
described herein. These and all other equivalents are intended to be encompassed by the 
following claims. All publications and references cited herein are expressly incorporated 
herein by reference in their entirety. 

What is claimed is: 



